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ABSTRACT: 

The present invention is a method and apparatus for performing filtering operations on a digital 
image One embodiment is enhancement of the contour fidelity of the image represented by a 
plurality of pixels, by storing pixel values representing a segment of the image in memory; 
isolating a plurality of regions of the pixels of said image segment to form a plurality of windows 
including a central pixel and a plurality of pixels surrounding said central pixel. Then comparing at 
least two of the regions of pixels within the windows with a set of standard pixel patterns for each 
of the windows and identifying matching pixel patterns within each of the windows. When 
matching patterns are identified, enhancing one or more pixels located at a correctable position 
when the central pixel is located at a correctable position in a plurality of the windows wherein the 
enhancement is accomplished in accordance with an enhancement associated with one of the 
windows and wherein the enhancement is determined in accordance with a predetermined 
hierarchy for the windows. 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(43) Date of publication: 

22.07.1998 Bulletin 1998/30 

(21) Application number: 98300400.3 

(22) Date of filing: 20.01.1998 



(n) EP 0 854 636 A2 

EUROPEAN PATENT APPLICATION 

(51) Intel 6: H04N 1/40, G06T3/40 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


• Loce, Robert P. 


NL PT SE 


Webster, NY 14580 (US) 


Designated Extension States: 


• Branclforte, Michael 


AL LT LV MK RO SI 


Rochester, NY 14606 (US) 


(30) Priority: 21.01.1997 US 784636 


(74) Representative: Reynolds, Julian David et al 




Rank Xerox Ltd 


(71) Applicant: XEROX CORPORATION 


Patent Department 


Rochester, New York 14644 (US) 


Parkway 




Marlow Buckinghamshire SL7 1 YL (GB) 



(54) Hierarchical template-matching filters 

(57) The present invention is a method and appara- 
tus for performing filtering operations on a digital image 
One embodiment is enhancement of the contour fidelity 
of the image represented by a plurality of pixels, by stor- 
ing pixel values representing a segment of the image in 
memory; isolating a plurality of regions of the pixels of 
said image segment to form a plurality of windows in- 
cluding a central pixel and a plurality of pixels surround- 
ing said central pixel. Then comparing at least two of the 
regions of pixels within the windows with a set of stand- 
ard pixel patterns for each of the windows and identify- 
ing matching pixel patterns within each of the windows. 
When matching patterns are identified, enhancing one 
or more pixels located at a correctable position when 
the central pixel is located at a correctable position in a 
plurality of the windows wherein the enhancement is ac- 
complished in accordance with an enhancement asso- 
ciated with one of the windows and wherein the en- 
hancement is determined in accordance with a prede- 
termined hierarchy for the windows. 
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Description 

This invention relates generally to hierarchically or- 
ganized filters for processing digital images, and more 
particularly to the use of hierarchically organized tem- 
plate-matching filters to accomplish the resolution en- 
hancement in a cost and computationally efficient man- 
ner. 

Others have proposed template matching tech- 
niques for more precisely controlling the size, position- 
ing and number of picture elements ( a pixels B ) that are 
exposed on a xerographic photoreceptor to render bit- 
mapped images. Heretofore, a number of patents and 
publications have disclosed resolution enhancement, 
and hierarchical template-matching. 

For example, US-A-4,437,122 to Walsh et al. de- 
scribes a method of resolution enhancement for a sys- 
tem receiving video display pixel information and pro- 
viding hard copy output. Enhancement is achieved by 
storing successive lines of video data in parallel shift 
registers, applying the output of the shift registers to a 
decoder, and generating driving signals for a printer 
head. The decoder "compares the pixels on the same 
lines as well as in preceding and succeeding lines that 
surround each specific input pixel to generate the printer 
head driving signal according to whether straight or 
curved line segments are to be formed" (col. 2, lines 
6-10). Moreover, enhancement of the central pixel may 
be determined by 'progressively examining an ordered 
table of matches to find an equivalent image and its re- 
lated enhancement" (col. 3, line 67 - col. 4, linel). 

US-A-4,847,64t to Tung teaches enhancing the 
printing of bitmapped images by the piecewise matching 
of the bitmap with predetermined stored templates of 
patterns to detect the occurrence of preselected bitmap 
features. Templates representing compound error ele- 
ments common to all bitmap images, associated com- 
pensation signals for each template, and the rules gov- 
erning the relationships between the matched templates 
and the associated compensation signals are compiled 
into an index matching table implemented in a high 
speed parallel logic array. 

The present invention is adaptable to apply tem- 
plate matching in any system that utilizes multiple pat- 
terns in a matching algorithm. Some common applica- 
tions include enhancement of digital documents, reso- 
lution conversion and enhancement of digital docu- 
ments, image restoration for aesthetic purposes, or hu- 
man and machine recognition (e.g., OCR, and other fea- 
ture recognition). Template matching has been effec- 
tively employed to overcome some of the sampling er- 
rors that are caused by the use of input data that is too 
coarse to accurately represent the higher spatial fre- 
quency content of an image. Note that coarseness re- 
fers to sampling in a manner that does not fully represent 
the information content of the image, which includes 
coarse spatial sampling (e.g., spots per inch(SPI)), and 
coarse quantization (e.g., 1 bit/pixel compared to 8 bits/ 



pixel). 

A specific applicatbn in which the present invention 
finds particular use is enhancement of images for elec- 
tronic printing. In electronic printing, digital character 
5 features are often recognized and based upon the rec- 
ognition and capability of the image writing member, var- 
ious types of enhanced pixel signals are generated and 
used to write the final printed or displayed image. Types 
of enhanced signals include increased quantization 
10 range (conversion of binary signal to gray-scale, which 
is commonly referred to as antialiasing), high address- 
able signals that control the writing spot over distances 
smaller than the spot itself, and pulse controlled signals 
that may activate the writing member (e.g., laser) some 
is preferred length of time that may be shorter than a nom- 
inal pixel period. 

High-addre6sability printers operate by scanning 
one or more intensity modulated scan spots over a high 
gamma, photosensitive recording medium in accord- 
20 ance with a scan pattern that causes the spot or spots 
to superimpose displaced multiple discrete exposures 
on the recording medium. High addressability typically 
refers to the ability to address the image writing member 
(e.g., laser) in spatial increments finer than the size of 
25 the writing spot, or nominal resolution of the imaging 
system. High addressability systems have substantially 
linear edge position responses, so that pixel signals 
modulated in accordance with the preselected values 
are used by these systems for spatially positioning the 
30 transitions that are contained by the images they render 
to a sub-pitch (smaller than the writing spot) precision. 
It is well known that the human visual system is partic- 
ularly sensitive to jagged edge transitions in image pat- 
terns, where this sensitivity is referred to as vernier acu- 
35 ity. The degree of edge placement precision enabled by 
high addressability aids in suppressing the appearance 
of jagged image artifacts caused by the coarse sam- 
pling. 

In accordance with the present invention, there is 
to provided a method of enhancing the contour fidelity of 
reproduction of an image represented by a plurality of 
pixels, comprising the steps of: 

storing pixel values representing a segment of the 
45 image in memory; 

isolating a plurality of regions of the pixels of said 
image segment to form a plurality of windows, each 
window being of different dimensions while includ- 
ing a common central pixel and a plurality of pixels 
50 surrounding said central pixel; 

comparing at least two of the regions of pixels within 
the windows with a set of standard pixel patterns for 
each of the windows; 

identifying matching pixel patterns within each of 
55 the windows; and 

enhancing the central pixel when the central pixel 
is located at a correctable position in only one of the 
windows, and enhancing the central pixel when the 
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central pixel is located at a correctable position in a 
plurality of the windows wherein the enhancement 
is accomplished in accordance with an enhance- 
ment associated with one of the windows and 
wherein the enhancement is determined in accord- 
ance with a predetermined hierarchy for the win- 
dows. 

Note that while the filter windows have been de- 
scribed as having a common central pixel, it is under- 
stood by those skilled in the art that the concepts are 
immediately extendible to windows that contain a plu- 
rality of common pixels. Use of multiple common pixels 
in window mapping is referred to as area mapping. See 
European application EP-A-744,861 for a description of 
an area mapping method that may employ the present 
invention. 

In accordance with another aspect of the present 
invention, there is provided an apparatus for enhancing 
the contour fidelity of reproduction of an image repre- 
sented by a plurality of pixels, comprising: 

memory for storing pixel values representing a seg- 
ment of the image; 

a plurality of windows for isolating a plurality of re- 
gions of the pixels of said image segment, each win- 
dow being of different dimensions while including a 
centraJ pixel and a plurality of pixels surrounding 
said central pixel; 

pattern matchers for comparing at least two of the 
regions of pixels within the windows with a set of 
standard pixel patterns for each of the windows and 
signaling the presence of matching pixel patterns 
within each of the windows; and 
said pattern matchers enhancing at least one output 
pixel when the output pixel is located at a correcta- 
ble position in only one of the windows, and enhanc- 
ing the output pixel when the output pixel is located 
at a correctable position in a plurality of the windows 
wherein the enhancement is accomplished in ac- 
cordance with an enhancement associated with one 
of the windows and wherein the enhancement is de- 
termined in accordance with a predetermined hier- 
archy for the windows. 

For each of the method and apparatus set out 
above, preferably a first of the plurality of windows con- 
sists of a window of a dimension NxN and a second of 
the plurality of windows comprises a window having at 
least one dimension greater than N. Preferably, N is 
equal to three. 

Preferably, the second of the plurality of windows is 
a more specific window, selected from group compris- 
ing, in increasing order of specificity: 

a 5x5 window, 

an orthogonal pair of 5x7 and 7x5 windows; 
a 7x7 window; and 



an orthogonal pair of 3x9 and 9x3 windows. 

One aspect of the invention is based on the recog- 
nition of a problem with conventional and high address- 

5 ability printing utilized to render enhanced exposure fi- 
delity to a photoreceptor or other recording media. Nor- 
mally the source of the high fidelity information is a sam- 
pled image or a high resolution bitmap. But many raster 
data sources provide low resolution bitmaps at 300 or 

10 400 bits per inch (12 or 16 bits/mm), which isnot enough 
resolution to eliminate u nwanted artifacts induced by the 
coarseness of the information, such as stairstepping 
While resolution enhancement to improve such render- 
ings is known, the present invention is directed to a com- 

15 putationally and cost-effective manner to achieve tem- 
plate-matching. 

The hierarchical design of the invention has the ad- 
vantage of simplifying and thereby reducing the cost and 
complexity of the implementation. Pattern templates are 

20 implemented in a set of hierarchical windows, in which 
the more specific pattern that receives a match has pri- 
ority over the smaller, more general patterns. Moreover, 
the patterns are arranged in accordance with the pattern 
size so as to reduce the storage necessary to implement 

25 the very specific patterns. 

The technique described above is advantageous 
because it efficiently reduces the storage requirements 
of a template-based resolution enhancement system 
while maintaining the ability to recognize very specific 

30 template patterns. As a result of the invention, resolution 
enhancement using hierarchical template -matching 
techniques may be accomplished with reduced tem- 
plate pattern storage. 

Embodiments of the invention will now be de- 

3S scribed, by way of example, with reference to the ac- 
companying drawings, in which: 

Figure 1 is an illustration of the general features of 
a laser printer; 

*o Figure 2 is a block diagram depicting elements of 
the data source shown in Figure 1 ; 
Figures 3 and 4 are illustrative embodiments of the 
hierarchical template-matching design for resolu- 
tion enhancement in accordance with embodiments 

45 of the present invention; 

Figure 5 is an exemplary illustration of two template 
windows as employed in embodiments of the 
present invention; and 

Figure 6 is an exemplary illustration of various im- 
50 age segments representing the outcome of various 
operations carried out in accordance with embodi- 
ments of the present invention. 

In the drawings, like reference numerals have been 
55 used throughout to designate identical elements. In de- 
scribing the present invention, the following term(s) 
have been used in the description. 

An "image" is a pattern of physical light. An image 



3 



5 



EP0 854 636 A2 



6 



may include characters, words, and text as well as other 
features such as graphics, including pictures. An image 
may be divided into "segments," each of which is itself 
an image. A segment of an image may be of any size 
up to and including the whole image. 5 

An item of data "defines" an image when the item 
of data includes sufficient information to produce the im- 
age. For example, a two-dimensional array can define 
all or any part of an image, with each item of data in the 
array providing a value indicating the color of a respec- 
tive location of the image. 

Each location in an image may be called a "pixel." 
In an array defining an image in which each item of data 
provides a value, each value indicating the color of a 
location may be called a "pixel value". Each pixel value 
is a bit in a "binary form" of an image, a gray scale value 
in a "gray scale form" of an image, or a set of color space 
coordinates in a "color coordinate form" of an image, the 
binary form, gray scale form, and color coordinate form 
each being a two-dimensional array defining an image. 
A "central pixel" is not literally the center pixel in a region, 
rather the term describes a target pixel that a plurality 
of template windows have in common. It will be appre- 
ciated that many or all of the pixels become the "central" 
or "target" pixel during the process of enhancing an en- 
tire image. 

A "high-addressability" pixel is a pixel for which the 
location and size of the mark to be rendered for the pixel 
can be controlled at a resolution higher than the pixel 
resolution. For example, a high-addressability pixel may 
be represented by a plurality of sub-pixels therein, 
where each subpixel may be rendered as blacker white 
(color, no color), it will be appreciated by those skilled 
in the art that other methods of accomplishing high-ad- 
dressability output may be dependent upon the marking 
engine employed, and that high -addressability is not 
necessarily limited to sub-pixel imaging techniques. 
"Resolution enhancement" is a process by which the 
pixels of an image are processed to produce either more 
pixels for the same spatial region or the same number 
of high-addressability pixels. 

An item of data "relates to" part of an image, such 
as a pixel or a larger segment of the image, when the 
item of data has a relationship of any kind to the part of 
the image. For example, the item of data could define 
the part of the image, as a pixel value defines a pixel; 
the item of data could be obtained from data defining 
the part of the image; the item of data could indicate a 
location of the part of the image; or the item of data could 
be part of a data array such that, when the data array is 
mapped onto the image, the item of data maps onto the 
part of the image. 

An operation performs "image processing" when it 
operates on an item of data that relates to part of an 
image. 

A "neighborhood operation" is an image processing 
operation that uses data relating to one part of an image 
to obtain data relating to another part of an image. 



Pixels are "neighbors" or "neighboring" within an im- 
age when there are no other pixels between them or if 
they meet an appropriate criterion for neighboring. For 
example, using a connectivity criterion if the pixels are 
rectangular and appear in rows and columns, each pixel 
has 4 strong neighbors, 4 weak neighbors or a total of 
8 neighboring pixels. 

A "version" of a first image is a second image pro- 
duced using an item of data defining the first image. The 
second image may be identical to the first image, or it 
may be modified by loss of resolution, by changing the 
data defining the first image, or by other processes that 
result in a modified version. 

An "image input device" is a device that can receive 
an image and provide an item or items of data defining 
a version of the image. A desktop "scanner" is an exam- 
ple of an image input device that receives an image by 
a scanning operation, such as by scanning a document. 

An "image output device" is a device that can re- 
ceive an item of data defining an image and provide the 
image as output. A "display" and a "laser printer" are 
examples of image output devices that provides the out- 
put image in human viewable form The visible pattern 
presented by a display is a "displayed image" or simply 
"image" while the visual pattern rendered on a substrate 
by the printer is a "printed image". 

■Raster output scanners" (ROSs), a type of image 
output device developed for xerographic printing, em- 
ploy a single beam or a multi-beam laser light source for 
supplying one or more intensity modulated light beams, 
together with a scanner (such as polygon scanner) for 
cyclically deflecting the modulated laser beam or beams 
across a photoreceptor in a "fast scan direction' while 
the photoreceptor is being advanced simultaneously in 
an orthogonal "process direction." In practice, each of 
the laser beams typically is brought to focus on or near 
the photoreceptor surface to provide a substantially fo- 
cused "scan spot " The scan spot, in turn, scans the pho- 
toreceptor in accordance with a predetermined scan 
pattern because the fast scan deflection of the laser 
beam or beams vectorially sums with the process direc- 
tion motion of the photoreceptor. While the following de- 
scription describes features of a single beam/single 
scan spot ROS for the sake of simplification, it is under- 
stood that the present invention also applies to printers 
and other display means that employ single beam or 
multi-beam ROSs, image bars, or other image writing 
devices. 

Referring to Figure 1, there is illustrated a more or 
less conventionally configured optical system 1 0 of a xe- 
rographic print engine (not shown) with which the 
present invention may be employed. The flying spot 
ROS scans a data modulated light beam 12 over a xe- 
rographic photoreceptor 14 in accordance with a prede- 
termined raster scanning pattern. To that end, the ROS 
comprises a laser diode 16 for emitting the light beam 
12 in the visible or invisible (e.g., infrared) band of the 
spectrum, together with a polygon 18 that has a plurality 
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of nearly identical, mirror-like exterior sidewalls or 'fac- 
ets" 20, 

Also a part of system 10 is a motor 22 for rotating 
the polygon 1 8 about its central axis, as indicated by the 
arrow 24, at a substantially constant angular velocity. 
The polygon 18 is optically aligned between the laser 
16 and the photoreceptor 14, so its rotation causes the 
laser beam 12 to be intercepted and reflected from one 
after another of the polygon facets 20, with the result 
being that beam 12 is cyclically swept across the pho- 
toreceptor 1 4 in a fast scan direction. The photoreceptor 
14, on the other hand, is advanced (by means not 
shown) simultaneously in a generally orthogonal, proc- 
ess direction at a substantially constant linear velocity, 
as indicated by the arrow 26, so the laser beam 1 2 scans 
the photoresponsrve surface 14 in accordance with a 
raster scan pattern. As shown, the photoresponsrve sur- 
face 14 is coated on a rotating drum 28, but it will be 
apparent that it also could be carried by a belt or any 
other suitable substrate. 

Typically, the ROS also includes pre-scan optics 30 
and post-scan optics 32 for bringing the laser beam 1 2 
to a generally circular focus proximate the photorespon- 
sive surface 14 and for providing any optical correction 
that may be needed to compensate for scanner wobble 
and other optical irregularities. Preferably, the optical 
aperture of the ROS is sufficiently large to avoid exces- 
sive truncation of the laser beam 1 2 because the beam 
1 2 then comes to a generally circular or elliptical focus 
with a gaussian intensity profile. However, the broader 
aspects of the instant invention are not limited to any 
specific scan spot geometry or intensity profile. 

The amplitude, duty cycle, and/or pulse width of the 
laser beam 12 is'preferably "modulated (collectively re- 
ferred to herein as 'intensity modulation 8 ) in accordance 
with successive multi-bit digital data values. These data 
values are clocked out of a data source 36 serially in 
response to data clock pulses that are time synchro- 
nized with the scan of the scan spot from bitmap location 
to bitmap location within the raster scan pattern. Thus, 
the data clock frequency can be selected (by means not 
shown) to map the data onto the raster scan pattern at 
any desired magnification, using either the same or dif- 
ferent magnifications in the fast scan and the process 
directions. The data may be preprocessed in accord- 
ance with aspects of the instant invention as will be de- 
scribed herein for the printing of halftoned images, 
graphics and/or text and other types of line art, so that 
the data source 36 generically represents any suitable 
source of raster data for intensity modulating the laser 
beam 12. In one embodiment, the drive current for the 
laser diode 16 is serially modulated by modulator 38 in 
accordance with the data values that are clocked out of 
the data source 36, thereby intensity modulating the la- 
ser beam 12 at the data clock rate in accordance with 
those data values. 

The fast scan positioning precision of the print en- 
gine 10 can be increased, if desired, by dynamically ad- 



justing the frequency of the data clock to compensate 
for positioning errors that tend to be caused by, for ex- 
ample, variations in the angular velocity of the polygon 
18 and facets 20, and localized variations in the geo- 
5 metric relationship of the polygon 1 8 to spatially distinct 
segments of any given scan line. In addition, the clock 
may be used to control signals to the laser at a rate that 
yields spatial addressing of the scan spot at intervals 
finer than the spot itself. One key application of this high 
addressability is the precise positioning of edges in a 
written image. 

Alternatively, the present invention may find partic- 
ular use in various image enhancement systems, for ex- 
ample, in resolution enhancement systems. 

Turning now to Figure 2, displayed therein is a block 
diagram illustrating the components of the data source 
36 shown in Figure 1. It will be appreciated by those 
skilled in the art that numerous sources of data, includ- 
ing image input devices (e.g., scanners), mass storage 
and networks (local, intranet and internet) may be em- 
ployed to provide a digital document in a page descrip- 
tion language (PDL). Examples of PDLs include Inter- 
press, PCL, and Postscript®, although documents rep- 
resented by other PDLs or other formats are intended 
to be included as well. Once a PDL document 50 is re- 
ceived by a printing system and stored in memory as- 
sociated therewith, the document is typically decom- 
posed or decompressed by a decomposer 52 to gener- 
ate a digital image of at least a portion of the document. 

Output of the PDL decomposer 52 is a bitmap image 
at a particular resolution, for example, 600 X 600 X 1 
(SPI x SPI x bit/pixel). However, in order to drive the 
high-addressability, systems for which the present in- 
vention is intended, the decomposer output is preferably 
further processed at resolution enhancer 54, where the 
digital image data is increased in resolution in at least 
one dimension. In one embodiment, to produce output 
suitable for driving a high-addressability printing system 
requiring four bits per pixel of image data, the resolution 
enhancer would be employed to convert the PDL de- 
composer output from 600 X 600 X 1 to 2400 X 600 X 
1 (i.e., 600 x 600 x 4) as depicted in Figure 2. It will be 
appreciated that other enhanced resolutions and en- 
hanced pixel signals are possible, and that the exam- 
ples employed herein with respect to resolutions are not 
intended to in any way limit the invention. As described 
above, the enhanced resolution digital data would then 
be employed to control, on a sub-pixel or high-address- 
ability basis, the modulation of the laser light source so 
as to render a resolution enhanced output. 

Having described the general embodiment for the 
present invention, attention is now turned to Figures 3 
and 4, which depict in more detail, various aspects of 
the template-matching resolution enhancement archi- 
tecture employed with respect to the instant invention. 
Figure 3 is an exemplary block diagram illustrating the 
hierarchical nature of the resolution enhancer. Upon re- 
ceiving input data at a first resolution, the data is passed 
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to a pair of template or pattern matching filters 60 and 
62. In a preferred embodiment, the hierarchical pattern 
matchers would be implemented in parallel with one an- 
other as depicted in Figures 3 and 4 so as to maintain 
the performance of the resolution enhancement archi- 
tecture. 

In pattern matching filters 60 and 62, data for a plu- 
rality of pixels located about a central pixel is compared 
to predefined patterns to identify a match. Whenever a 
match is detected, the pattern matchers output a reso- 
lution enhanced set of pixels or enhanced pixel signal 
for the central and surrounding pixels. However, in order 
to avoid the possibility of contention whenever both of 
the pattern matching filters within matchers 60 and 62 
detect similar patterns, a hierarchical system is re- 
quired. The system employed herein is one that gives 
preference to the larger, more specific pattern matching 
filters - in this example the 5 X 5 pattern matcher - using 
a multiplexer 64 controlled via a select line that indicates 
a match in the larger pattern matcher block. 

In order to further illustrate the operation of the hi- 
erarchical pattern-matching system of Figure 3, atten- 
tion is briefly turned to Figures 5 and 6, where bitmap 
examples are depicted. In Figure 5, the 3 x 3 and 5 x 
5 pattern windows are superimposed on one another; 
both centered about the central pixel C. As will be ap- 
preciated by those skilled in the art, the 5 X 5 window 
contains significantly more image context than the 
smaller window. The additional information of the larger 
window allows for a better estimate of the slope of an 
observed edge. Once the slope is estimated, highly ad- 
dressable signals are generated that are appropriate for 
enhancing the image to appear with the correct slope 
and without jagged transitions. A better estimate of the 
slope will yield a better appearing enhancement. The 
slope estimation is implicit to the template design pro- 
cedure. However, it is also known that the storage re- 
quirements for all possible patterns in the 5 X 5 window 
is significantly greater, 2^ for the latter versus 2 9 for the 
former. Thus, the present invention would employ the 5 
X 5 patterns only where necessary to add context to the 
smaller set of 3 x 3 patterns. 

An illustrative example is found in Figure 6. There, 
given an input bitmap 100, with a central pixel C hap- 
pening to fall at a transition along the vertical contour or 
edge, image enhancement would be desirable to 
smooth the transition. In particular, it would be desirable 
to accomplish the transition along the vertical contour 
over a number of pixels, as illustrated for example in im- 
age segment 102. Segment 102, processed in accord- 
ance with the 3 X 3 pattern match, would have identified 
the transition correctly and would compensate by reduc- 
ing the exposure for central pixel C to approximately 
one-half the level of an exposed pixel. This would obvi- 
ously result in a smoother transition. However, when 
compared to the enhancement that would have resulted 
if the 5 X 5 pattern match were employed to control the 
transition, bitmap 104, it is apparent that the transition 



should be spread over an even larger vertical range of 
pixels (e.g., pixels C^, C, C +1 ). 

Recognizing that the 5 x 5 pattern matcher would 
produce the preferred output whenever a relevant pat- 
5 tern is identified, the hierarchical relationship is estab- 
lished. As illustrated in Figure 3, pattern matcher 62 not 
only outputs the enhanced pixel data generated in re- 
sponse to a recognized pattern, but a signal indicating 
that a match was present as well. The match signal can 
then be employed as a select signal in the 2-input mul- 
tiplexer 64 to select the 5 x 5 output whenever there is 
a match. 

The pattern-matching design of Figure 3 does not 
require that the 5 X 5 pattern matcher contain all 2 25 
possible patterns as a number of the patterns would be 
duplicative of those that would be recognized and treat- 
ed appropriately by the 3 x 3 pattern matcher. Thus, 
pattern matcher 62 can be optimized, using statistical 
techniques as described by Loce et al. in US-A- 
5,359,423 and US-A-5, 387,985 so as to reduce the 
number of patterns to be recognized, thereby further re- 
ducing the pattern storage requirements of such a sys- 
tem. 

An alternative embodiment of resolution enhancer 
54 is depicted in Figure 4. There, additional hierarchical 
pattern matchers are depicted so as to further expand 
the ability to recognize and enhance particular patterns 
within the input image. For example, an orthogonal pair 
of template-matchers 70 and 72 have been added to the 
device depicted in Figure 3. The 3 X 9 and 9 X 3 pattern 
matchers are particularly useful in identifying longer hor- 
izontal and vertical contour transitions, for example, as 
illustrated by bitmap 106 in Figure 6. The present inven- 
tion further encompasses alternative embodiments em- 
ploying a number of otherfilterdimensions as represent- 
ed by N X N pattern matcher 80. Possible additional or 
alternative pattern matchers include, 7 X 7, 9 X 9, 7 X 
3, 3 X 7, 7 X 5, 5 X 7, 9 X 5 and 5 X 9. As illustrated 
in Figure 4, each of the pattern matchers would generate 
not only an enhanced output pixels in response to a 
match, but a match signal as well. The match signals of 
an orthogonally paired pattern matcher are preferably 
mutually exclusive and may be combined by a simple 
logic circuit 74 so that only a single match signal is gen- 
erated by the pair. For example, a preferred set may be 
3x3, (5x3, 3x5). (7x3. 3x7). (9x3, 3x9) 

As a result of the additional pattern matchers, it is 
necessary to add selection control logic 68 to multiplex- 
er 64 Selection control logic 68 is pre-programmed to 
reflect the hierarchy of the template-matching filters. In 
a preferred embodiment, the hierarchy of the selection 
logic would place enhancement by the more specific fil- 
ters at a higher level, and the more general filters at a 
lower level. For example, the 9 X 3 or 3 X 9 pattern 
matchers would be selected over the orthogonal pairs 
7x3, 3x7 and 5x3, 3x5, and over the smaller square win- 
dows 3X3, 5X5 or 7X7 pattern matcher. In a pre- 
ferred embodiment, the pattern matchers, as depicted, 
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operate in parallel so as to concurrently generate en- 
hanced output in response to a common central pixel. 
Moreover, the system preferably operates at or above 
a data rate sufficient to provide the enhanced image da- 
ta to printing system 10 at its processing speed. 

In recapitulation, the present invention is a method 
and apparatus for enhancing the contour fidelity of an 
image represented by a plurality of pixels, by storing pix- 
el values representing a segment of the image in mem- 
ory; isolating a plurality of regions of the pixels of said 
image segment to form a plurality of windows including 
a central pixel and a plurality of pixels surrounding said 
central pixel. Then comparing at least two of the regions 
of pixels within the windows with a set of standard pixel 
patterns for each of the windows and identifying match- 
ing pixel patterns within each of the windows. When 
matching patterns are identified, enhancing one or more 
pixels located at a correctable position when the central 
pixel is located at a correctable position in a plurality of 
the windows wherein the enhancement is accomplished 
in accordance with an enhancement associated with 
one of the windows and wherein the enhancement is 
determined in accordance with a predetermined hierar- 
chy for the windows. 

To better understand the scope of the present hier- 
archical filtering method, we note that pattern matching 
is not restricted to binary images. Gray-scale pattern 
matching and patterning matching in color imagery is 
also comprehended by the present invention. We also 
note that the meaning of "pattern match 0 is not restricted 
to an ideal one-to-one correspondence. Rather, it refers 
to matching to a significant degree as determined by 
some decision making criterion, as is understood in the 
fields of image region classification, statistical decision 
making, and others. 



Claims 

1. A method of enhancing an image represented by a 
plurality of pixels, comprising the steps of: 

(a) storing pixel values representing a segment 
of the image in memory; 

(b) isolating a plurality of regions of the pixels 
of said image segment to form a plurality of win- 
dows, each window being of different dimen- 
sions while including a central pixel and a plu- 
rality of pixels surrounding said central pixel; 

(c) comparing at least two of the regions of pix- 
els within the windows with a set of standard 
pixel patterns for each of the windows; 

(d) identifying matching pixel patterns within 
each of the windows; and 

(e) enhancing the central pixel when the central 
pixel is located at a correctable position in only 
one of the windows, and enhancing the central 
pixel when the central pixel is located at a cor- 



rectable position in a plurality of the windows 
wherein the enhancement is accomplished in 
accordance with an enhancement associated 
with one of the windows and wherein the en- 
5 hancement is determined in accordance with a 

predetermined hierarchy for the windows. 

2. The method of claim 1 , wherein step (c) comprises 
comparing said at least two of the regions of pixels 

10 within the windows concurrently. 

3. The apparatus of claim 1 or 2, wherein the prede- 
termined hierarchy is in order of specific pixel pat- 
terns to general pixel patterns and where the gen- 

*5 eral pixel patterns are represented by windows that 
are smaller than the windows associated with spe- 
cific pixel patterns. 

4. The method of claim 1 , 2 or 3, wherein step (e) com- 
20 prises applying the enhancement to the central pix- 
el and at least one neighboring pixel. 

5. The method of claim 4, wherein step (e) results in 
the enhancement of a plurality of pixels surrounding 

25 the central pixel. 

6. An apparatus for enhancing an image represented 
by a plurality of pixels, comprising: 

30 memory for storing pixel values representing a 

segment of the image; 

a plurality of windows for isolating a plurality of 
regions of the pixels of .said image segment, 
each window being of different dimensions 

3S while including a central pixel and a plurality of 

pixels surrounding said central pixel; 
a plurality of pattern matchers for comparing at 
least two of the regions of pixels within the win- 
dows with a set of standard pixel patterns for 

40 each of the windows and signaling the pres- 

ence of matching pixel patterns within each of 
the windows; and 

said pattern matchers enhancing at least one 
output pixel when the output pixel is located at 

45 a correctable position in only one of the win- 

dows, and enhancing the output pixel when the 
output pixel is located at a correctable position 
in a plurality of the windows wherein the en- 
hancement is accomplished in accordance with 

50 an enhancement associated with one of the 

windows and wherein the enhancement is de- 
termined in accordance with a predetermined 
hierarchy for the windows. 

55 7. The apparatus of claim 6, wherein the plurality of 
pattern matchers are adapted to operate concur- 
rently on the pixels within the windows. 
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8. The apparatus of claim 6 or 7, wherein the prede- 
termined hierarchy is in order of specific pixel pat- 
terns to general pixel patterns and where the gen- 
eral pixel patterns are represented by windows that 
are smaller than the windows associated with spe- 5 
cific pixel patterns. 

9. The apparatus of claim 6, 7 or 8, wherein the pattern 
matchers are adapted to alter the central pixel and 

at least one neighboring pixel. 10 

10. The apparatus of claim 15, wherein the pattern 
matchers are adapted to enhance a plurality of pix- 
els surrounding the central pixel. 
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